Artificial intelligence chatbots and large language models in dental education: Worldwide survey of educators.

INTRODUCTION: Interest is growing in the potential of artificial intelligence (AI) chatbots and large language models like OpenAI's ChatGPT and Google's Gemini, particularly in dental education. To explore dental educators' perceptions of AI chatbots and large language models, specifically their potential benefits and challenges for dental education. MATERIALS AND METHODS: A global cross-sectional survey was conducted in May-June 2023 using a 31-item online-questionnaire to assess dental educators' perceptions of AI chatbots like ChatGPT and their influence on dental education. Dental educators, representing diverse backgrounds, were asked about their use of AI, its perceived impact, barriers to using chatbots, and the future role of AI in this field. RESULTS: 428 dental educators (survey views = 1516; response rate = 28%) with a median [25/75th percentiles] age of 45 [37, 56] and 16 [8, 25] years of experience participated, with the majority from the Americas (54%), followed by Europe (26%) and Asia (10%). Thirty-one percent of respondents already use AI tools, with 64% recognising their potential in dental education. Perception of AI's potential impact on dental education varied by region, with Africa (4[4-5]), Asia (4[4-5]), and the Americas (4[3-5]) perceiving more potential than Europe (3[3-4]). Educators stated that AI chatbots could enhance knowledge acquisition (74.3%), research (68.5%), and clinical decision-making (63.6%) but expressed concern about AI's potential to reduce human interaction (53.9%). Dental educators' chief concerns centred around the absence of clear guidelines and training for using AI chatbots. CONCLUSION: A positive yet cautious view towards AI chatbot integration in dental curricula is prevalent, underscoring the need for clear implementation guidelines.

Evaluation of ChatGPT's Real-Life Implementation in Undergraduate Dental Education: Mixed Methods Study.

BACKGROUND: The recent artificial intelligence tool ChatGPT seems to offer a range of benefits in academic education while also raising concerns. Relevant literature encompasses issues of plagiarism and academic dishonesty, as well as pedagogy and educational affordances; yet, no real-life implementation of ChatGPT in the educational process has been reported to our knowledge so far. OBJECTIVE: This mixed methods study aimed to evaluate the implementation of ChatGPT in the educational process, both quantitatively and qualitatively. METHODS: In March 2023, a total of 77 second-year dental students of the European University Cyprus were divided into 2 groups and asked to compose a learning assignment on "Radiation Biology and Radiation Protection in the Dental Office," working collaboratively in small subgroups, as part of the educational semester program of the Dentomaxillofacial Radiology module. Careful planning ensured a seamless integration of ChatGPT, addressing potential challenges. One group searched the internet for scientific resources to perform the task and the other group used ChatGPT for this purpose. Both groups developed a PowerPoint (Microsoft Corp) presentation based on their research and presented it in class. The ChatGPT group students additionally registered all interactions with the language model during the prompting process and evaluated the final outcome; they also answered an open-ended evaluation questionnaire, including questions on their learning experience. Finally, all students undertook a knowledge examination on the topic, and the grades between the 2 groups were compared statistically, whereas the free-text comments of the questionnaires were thematically analyzed. RESULTS: Out of the 77 students, 39 were assigned to the ChatGPT group and 38 to the literature research group. Seventy students undertook the multiple choice question knowledge examination, and examination grades ranged from 5 to 10 on the 0-10 grading scale. The Mann-Whitney U test showed that students of the ChatGPT group performed significantly better (P=.045) than students of the literature research group. The evaluation questionnaires revealed the benefits (human-like interface, immediate response, and wide knowledge base), the limitations (need for rephrasing the prompts to get a relevant answer, general content, false citations, and incapability to provide images or videos), and the prospects (in education, clinical practice, continuing education, and research) of ChatGPT. CONCLUSIONS: Students using ChatGPT for their learning assignments performed significantly better in the knowledge examination than their fellow students who used the literature research methodology. Students adapted quickly to the technological environment of the language model, recognized its opportunities and limitations, and used it creatively and efficiently. Implications for practice: the study underscores the adaptability of students to technological innovations including ChatGPT and its potential to enhance educational outcomes. Educators should consider integrating ChatGPT into curriculum design; awareness programs are warranted to educate both students and educators about the limitations of ChatGPT, encouraging critical engagement and responsible use.

Evaluation of the Performance of Generative AI Large Language Models ChatGPT, Google Bard, and Microsoft Bing Chat in Supporting Evidence-Based Dentistry: Comparative Mixed Methods Study.

BACKGROUND: The increasing application of generative artificial intelligence large language models (LLMs) in various fields, including dentistry, raises questions about their accuracy. OBJECTIVE: This study aims to comparatively evaluate the answers provided by 4 LLMs, namely Bard (Google LLC), ChatGPT-3.5 and ChatGPT-4 (OpenAI), and Bing Chat (Microsoft Corp), to clinically relevant questions from the field of dentistry. METHODS: The LLMs were queried with 20 open-type, clinical dentistry-related questions from different disciplines, developed by the respective faculty of the School of Dentistry, European University Cyprus. The LLMs' answers were graded 0 (minimum) to 10 (maximum) points against strong, traditionally collected scientific evidence, such as guidelines and consensus statements, using a rubric, as if they were examination questions posed to students, by 2 experienced faculty members. The scores were statistically compared to identify the best-performing model using the Friedman and Wilcoxon tests. Moreover, the evaluators were asked to provide a qualitative evaluation of the comprehensiveness, scientific accuracy, clarity, and relevance of the LLMs' answers. RESULTS: Overall, no statistically significant difference was detected between the scores given by the 2 evaluators; therefore, an average score was computed for every LLM. Although ChatGPT-4 statistically outperformed ChatGPT-3.5 (P=.008), Bing Chat (P=.049), and Bard (P=.045), all models occasionally exhibited inaccuracies, generality, outdated content, and a lack of source references. The evaluators noted instances where the LLMs delivered irrelevant information, vague answers, or information that was not fully accurate. CONCLUSIONS: This study demonstrates that although LLMs hold promising potential as an aid in the implementation of evidence-based dentistry, their current limitations can lead to potentially harmful health care decisions if not used judiciously. Therefore, these tools should not replace the dentist's critical thinking and in-depth understanding of the subject matter. Further research, clinical validation, and model improvements are necessary for these tools to be fully integrated into dental practice. Dental practitioners must be aware of the limitations of LLMs, as their imprudent use could potentially impact patient care. Regulatory measures should be established to oversee the use of these evolving technologies.

Dental students' and faculty perception of online exams with e-invigilation in Cyprus.

INTRODUCTION: During the recent pandemic, e-learning and e-assessment methods have been implemented worldwide, providing opportunities for further implementation in the dental curriculum. This study aims to research the dental students' and dental faculty's perceptions of online exams with e-invigilation. MATERIALS AND METHODS: Online questionnaires were developed and delivered, after three semesters of online exams, to all students and faculty. Descriptive statistics were performed, and answers were grouped into Principal Components (PC) using Principal Component Analysis (PCA). Statistical significance was set at p < .05. RESULTS: Two-hundred and sixty dental students (83.7%) and 24 dental faculty members (63.1%) answered the online questionnaires. PCA of students' responses revealed 4 PC, 'University support to students', 'Comparison between online and face-to-face exams', 'Preparation for the online exams' and 'Attitudes towards the technology used for the online exams'. PCA of faculty responses revealed 5 PC: 'Comparison between online and face-to-face exams', 'University support to faculty', 'Faculty attitudes towards the exam procedures', 'Human factors associated with the exam procedures' and 'Exam invigilation'. The overall satisfaction was high for both staff and students (higher for students and female staff). Students with previous experience in online exams scored more positively than first-year students. University support, process-related stress and e-invigilation were highlighted. CONCLUSIONS: The overall satisfaction with the e-exams was high, despite the technical problems, time-consuming processes and related stress. University support (training, IT support and resources) and mock exams emerged as important elements of online exams, as was the e-invigilation, which students perceived as efficient and non-intrusive.

Online videos: The hidden curriculum.

INTRODUCTION: Dental undergraduates will access the Internet searching for learning materials to complement their training; however, open access content is not generally recommended by dental schools. This study aimed to evaluate how dental students are using online video content. MATERIALS AND METHODS: Students from eight Universities (Athens, Birmingham, Brescia, Cardiff, Melbourne, Paris, Sao Paulo and Valdivia) representing three continents were invited to complete a survey on their access and learning from online videos. RESULTS: International students behave similarly when studying dental content online. Of 515 respondents, 94.6% use the Internet as a learning tool. It was observed that videos are not frequently recommended during didactic lectures (9.6%). But many students (79.9%) will use YouTube for their learning which includes clinical procedures. Students will check online content before performing procedures for the first time (74.8%), to understand what was explained in class (65.9%) or read in books (59.5%), to relearn clinical techniques (64.7%) and to visualise rare procedures (49.8%). More than half of the students do not fully trust the accuracy or the reliability of online content. This does not prevent students from watching and sharing dental videos with classmates (64.4%). The content watched is not shared with teachers (23.3%) even when it contradicts what was learnt in the school (38.2%). CONCLUSION: This study concludes that students regularly integrate open access digital resources into learning portfolios but are hesitant to inform their teachers about their viewing habits. Students wish to receive critical skills on how to evaluate the material they encounter outside their traditional learning space.

Tackling the challenge of the impact of continuing education: An evidence synthesis charting a global, cross-professional shift away from counting hours.

INTRODUCTION: Health professionals worldwide are required to maintain their knowledge and skills through continuing education. However, there is limited evidence that the accumulation of hours of educational activity enhances practice. The aim of this study was to review evidence of the impact of continuing professional development (CPD), best educational practice and new models of CPD requirements. METHODS: We conducted a rapid evidence synthesis, reviewing literature and websites on continuing education for healthcare and non-healthcare professionals. RESULTS: We extracted data from 184 publications. Evidence of changed practice and improved patient care is uncommon in studies of CPD. What evidence there is suggests that activities are more likely to have impact if a combination of methods is used and if they are aligned with learning needs. Impact is also affected by the learner and their work environment. In terms of CPD requirements, we identified three models: input-based; outcomes-based and mixed models. We found a clear shift from quantitative, time-serving, input-models to outcomes-focused models which emphasise the identification of learning needs, selection of educational activity relevant to practice and reflection on practice improvement. Across a range of professions, recently updated CPD regulations no longer require registrants to accumulate CPD hours/points/credits. CONCLUSION: Outcomes-based models support registrants' engagement in relevant, meaningful CPD which holds greater potential to positively impact on practice and strengthen patient safety. In funding this study, the UK General Dental Council exemplifies its commitment to reviewing its CPD requirments.